How to spot a statistical problem: advice for a non-statistical reviewer

Statistical analyses presented in general medical journals are becoming increasingly sophisticated. BMC Medicine relies on subject reviewers to indicate when a statistical review is required. We consider this policy and provide guidance on when to recommend a manuscript for statistical evaluation. Indicators for statistical review include insufficient detail in methods or results, some common statistical issues and interpretation not based on the presented evidence. Reviewers are required to ensure that the manuscript is methodologically sound and clearly written. Within that context, they are expected to provide constructive feedback and opinion on the statistical design, analysis, presentation and interpretation. If reviewers lack the appropriate background to positively confirm the appropriateness of any of the manuscript’s statistical aspects, they are encouraged to recommend it for expert statistical review

Effectiveness of physiotherapy exercise following hip arthroplasty for osteoarthritis: a systematic review of clinical trials

Background: Physiotherapy has long been a routine component of patient rehabilitation following hip joint replacement. The purpose of this systematic review was to evaluate the effectiveness of physiotherapy exercise after discharge from hospital on function, walking, range of motion, quality of life and muscle strength, for osteoarthritic patients following elective primary total hip arthroplasty. Methods: Design: Systematic review, using the Cochrane Collaboration Handbook for Systematic Reviews of Interventions and the Quorom Statement. Database searches: AMED, CINAHL, EMBASE, KingsFund, MEDLINE, Cochrane library (Cochrane reviews, Cochrane Central Register of Controlled Trials, DARE), PEDro, The Department of Health National Research Register. Handsearches: Physiotherapy, Physical Therapy, Journal of Bone and Joint Surgery (Britain) Conference Proceedings. No language restrictions were applied. Selection: Trials comparing physiotherapy exercise versus usual/standard care, or comparing two types of relevant exercise physiotherapy, following discharge from hospital after elective primary total hip replacement for osteoarthritis were reviewed. Outcomes: Functional activities of daily living, walking, quality of life, muscle strength and range of hip joint motion. Trial quality was extensively evaluated. Narrative synthesis plus meta-analytic summaries were performed to summarise the data. Results: 8 trials were identified. Trial quality was mixed. Generally poor trial quality, quantity and diversity prevented explanatory meta-analyses. The results were synthesised and meta-analytic summaries were used where possible to provide a formal summary of results. Results indicate that physiotherapy exercise after discharge following total hip replacement has the potential to benefit patients. Conclusion: Insufficient evidence exists to establish the effectiveness of physiotherapy exercise following primary hip replacement for osteoarthritis. Further well designed trials are required to determine the value of post discharge exercise following this increasingly common surgical procedure

Power grip, pinch grip, manual muscle testing or thenar atrophy - which should be assessed as a motor outcome after carpal tunnel decompression? A systematic review

<p>Abstract</p> <p>Background</p> <p>Objective assessment of motor function is frequently used to evaluate outcome after surgical treatment of carpal tunnel syndrome (CTS). However a range of outcome measures are used and there appears to be no consensus on which measure of motor function effectively captures change. The purpose of this systematic review was to identify the methods used to assess motor function in randomized controlled trials of surgical interventions for CTS. A secondary aim was to evaluate which instruments reflect clinical change and are psychometrically robust.</p> <p>Methods</p> <p>The bibliographic databases Medline, AMED and CINAHL were searched for randomized controlled trials of surgical interventions for CTS. Data on instruments used, methods of assessment and results of tests of motor function was extracted by two independent reviewers.</p> <p>Results</p> <p>Twenty-two studies were retrieved which included performance based assessments of motor function. Nineteen studies assessed power grip dynamometry, fourteen studies used both power and pinch grip dynamometry, eight used manual muscle testing and five assessed the presence or absence of thenar atrophy. Several studies used multiple tests of motor function. Two studies included both power and pinch strength and reported descriptive statistics enabling calculation of effect sizes to compare the relative responsiveness of grip and pinch strength within study samples. The study findings suggest that tip pinch is more responsive than lateral pinch or power grip up to 12 weeks following surgery for CTS.</p> <p>Conclusion</p> <p>Although used most frequently and known to be reliable, power and key pinch dynamometry are not the most valid or responsive tools for assessing motor outcome up to 12 weeks following surgery for CTS. Tip pinch dynamometry more specifically targets the thenar musculature and appears to be more responsive. Manual muscle testing, which in theory is most specific to the thenar musculature, may be more sensitive if assessed using a hand held dynamometer – the Rotterdam Intrinsic Handheld Myometer. However further research is needed to evaluate its reliability and responsiveness and establish the most efficient and psychometrically robust method of evaluating motor function following surgery for CTS.</p

Exercise therapy, manual therapy, or both, for osteoarthritis of the hip or knee: a factorial randomised controlled trial protocol

<p>Abstract</p> <p>Background</p> <p>Non-pharmacological, non-surgical interventions are recommended as the first line of treatment for osteoarthritis (OA) of the hip and knee. There is evidence that exercise therapy is effective for reducing pain and improving function in patients with knee OA, some evidence that exercise therapy is effective for hip OA, and early indications that manual therapy may be efficacious for hip and knee OA. There is little evidence as to which approach is more effective, if benefits endure, or if providing these therapies is cost-effective for the management of this disorder. The MOA Trial (Management of OsteoArthritis) aims to test the effectiveness of two physiotherapy interventions for improving disability and pain in adults with hip or knee OA in New Zealand. Specifically, our primary objectives are to investigate whether:</p> <p>1. Exercise therapy versus no exercise therapy improves disability at 12 months;</p> <p>2. Manual physiotherapy versus no manual therapy improves disability at 12 months;</p> <p>3. Providing physiotherapy programmes in addition to usual care is more cost-effective than usual care alone in the management of osteoarthritis at 24 months.</p> <p>Methods</p> <p>This is a 2 × 2 factorial randomised controlled trial. We plan to recruit 224 participants with hip or knee OA. Eligible participants will be randomly allocated to receive either: (a) a supervised multi-modal exercise therapy programme; (b) an individualised manual therapy programme; (c) both exercise therapy and manual therapy; or, (d) no trial physiotherapy. All participants will continue to receive usual medical care. The outcome assessors, orthopaedic surgeons, general medical practitioners, and statistician will be blind to group allocation until the statistical analysis is completed. The trial is funded by Health Research Council of New Zealand Project Grants (Project numbers 07/199, 07/200).</p> <p>Discussion</p> <p>The MOA Trial will be the first to investigate the effectiveness and cost-effectiveness of providing physiotherapy programmes of this kind, for the management of pain and disability in adults with hip or knee OA.</p> <p>Trial registration</p> <p>Australian New Zealand Clinical Trials Registry ref: ACTRN12608000130369.</p

Systematic review of prognostic models in traumatic brain injury

BACKGROUND: Traumatic brain injury (TBI) is a leading cause of death and disability world-wide. The ability to accurately predict patient outcome after TBI has an important role in clinical practice and research. Prognostic models are statistical models that combine two or more items of patient data to predict clinical outcome. They may improve predictions in TBI patients. Multiple prognostic models for TBI have accumulated for decades but none of them is widely used in clinical practice. The objective of this systematic review is to critically assess existing prognostic models for TBI METHODS: Studies that combine at least two variables to predict any outcome in patients with TBI were searched in PUBMED and EMBASE. Two reviewers independently examined titles, abstracts and assessed whether each met the pre-defined inclusion criteria. RESULTS: A total of 53 reports including 102 models were identified. Almost half (47%) were derived from adult patients. Three quarters of the models included less than 500 patients. Most of the models (93%) were from high income countries populations. Logistic regression was the most common analytical strategy to derived models (47%). In relation to the quality of the derivation models (n:66), only 15% reported less than 10% pf loss to follow-up, 68% did not justify the rationale to include the predictors, 11% conducted an external validation and only 19% of the logistic models presented the results in a clinically user-friendly way CONCLUSION: Prognostic models are frequently published but they are developed from small samples of patients, their methodological quality is poor and they are rarely validated on external populations. Furthermore, they are not clinically practical as they are not presented to physicians in a user-friendly way. Finally because only a few are developed using populations from low and middle income countries, where most of trauma occurs, the generalizability to these setting is limited

Reliability of sickness certificates in detecting potential sick leave reduction by modifying working conditions: a clinical epidemiology study

BACKGROUND: Medical sickness certificates are generally the main source for information when scrutinizing the need for aimed intervention strategies to avoid or reduce the individual and community side effects of sick leave. This study explored the value of medical sickness certificates related to daily work in Norwegian National Insurance Offices to identify sick-listed persons, where modified working conditions might reduce the ongoing sick leave. METHODS: The potential for reducing the ongoing sick leave by modifying working conditions was individually assessed on routine sickness certificates in 999 consecutive sick leave episodes by four Norwegian National Insurance collaborators, two with and two without formal medical competence. The study took place in Northern Norway in 1997 and 1998. Agreement analysed with differences against mean, kappa, and proportional-agreement analysis within and between groups of assessors was used in the judgement. Agreements between the assessors and the self-assessment of sick-listed subjects were additionally analysed in 159 sick-leave episodes. RESULTS: Both sick-listed subjects and National Insurance collaborators anticipated a potential reduction in sick leave in 20–30% of cases, and in another 20% the potential was assessed as possible. The chance corrected agreements, however, were poor (k < 0.20) within and between groups of National Insurance collaborators. The agreement between National Insurance collaborators and the sick-listed subjects was no better than chance. Neither extended medical information nor formal medical competence increased agreement in cases where modified working conditions might have reduced sick leave. CONCLUSION: Information in medical sickness certificates proved ineffective in detecting cases where modified working conditions may reduce sick leave, and focusing on medical certificates may prevent identification of needed interventions. Strategies on how to communicate directly with sick-listed subjects would enable social authorities to exploit more of the sick leave reduction potential by modifying the working conditions than strategies on improving medical information

Brief Overview of Bioinformatics Activities in Singapore

10.1371/journal.pcbi.1000508PLoS Computational Biology5

Does parallel item content on WOMAC's Pain and Function Subscales limit its ability to detect change in functional status?

BACKGROUND: Although the Western Ontario and McMaster University Osteoarthritis Index (WOMAC) is considered the leading outcome measure for patients with osteoarthritis of the lower extremity, recent work has challenged its factorial validity and the physical function subscale's ability to detect valid change when pain and function display different profiles of change. This study examined the etiology of the WOMAC's physical function subscale's limited ability to detect change in the presence of discordant changes for pain and function. We hypothesized that the duplication of some items on the WOMAC's pain and function subscales contributed to this shortcoming. METHODS: Two eight-item physical function scales were abstracted from the WOMAC's 17-item physical function subscale: one contained activities and themes that were duplicated on the pain subscale (SIMILAR-8); the other version avoided overlapping activities (DISSIMILAR-8). Factorial validity of the shortened measures was assessed on 310 patients awaiting hip or knee arthroplasty. The shortened measures' abilities to detect change were examined on a sample of 104 patients following primary hip or knee arthroplasty. The WOMAC and three performance measures that included activity specific pain assessments – 40 m walk test, stair test, and timed-up-and-go test – were administered preoperatively, within 16 days of hip or knee arthroplasty, and at an interval of greater than 20 days following the first post-surgical assessment. Standardized response means were used to quantify change. RESULTS: The SIMILAR-8 did not demonstrate factorial validity; however, the factorial structure of the DISSIMILAR-8 was supported. The time to complete the performance measures more than doubled between the preoperative and first postoperative assessments supporting the theory that lower extremity functional status diminished over this interval. The DISSIMILAR-8 detected this deterioration in functional status; however, no significant change was noted for the SIMILAR-8. The WOMAC pain scale demonstrated a slight reduction in pain and the performance specific pain measures did not reflect a change in pain. All measures showed substantial improvement over the second assessment interval. CONCLUSIONS: These findings support the hypothesis that activity overlap on the pain and function subscales plays a causal role in limiting the WOMAC physical function subscale's ability to detect change

Length of sick leave – Why not ask the sick-listed? Sick-listed individuals predict their length of sick leave more accurately than professionals

BACKGROUND: The knowledge of factors accurately predicting the long lasting sick leaves is sparse, but information on medical condition is believed to be necessary to identify persons at risk. Based on the current practice, with identifying sick-listed individuals at risk of long-lasting sick leaves, the objectives of this study were to inquire the diagnostic accuracy of length of sick leaves predicted in the Norwegian National Insurance Offices, and to compare their predictions with the self-predictions of the sick-listed. METHODS: Based on medical certificates, two National Insurance medical consultants and two National Insurance officers predicted, at day 14, the length of sick leave in 993 consecutive cases of sick leave, resulting from musculoskeletal or mental disorders, in this 1-year follow-up study. Two months later they reassessed 322 cases based on extended medical certificates. Self-predictions were obtained in 152 sick-listed subjects when their sick leave passed 14 days. Diagnostic accuracy of the predictions was analysed by ROC area, sensitivity, specificity, likelihood ratio, and positive predictive value was included in the analyses of predictive validity. RESULTS: The sick-listed identified sick leave lasting 12 weeks or longer with an ROC area of 80.9% (95% CI 73.7–86.8), while the corresponding estimates for medical consultants and officers had ROC areas of 55.6% (95% CI 45.6–65.6%) and 56.0% (95% CI 46.6–65.4%), respectively. The predictions of sick-listed males were significantly better than those of female subjects, and older subjects predicted somewhat better than younger subjects. Neither formal medical competence, nor additional medical information, noticeably improved the diagnostic accuracy based on medical certificates. CONCLUSION: This study demonstrates that the accuracy of a prognosis based on medical documentation in sickness absence forms, is lower than that of one based on direct communication with the sick-listed themselves